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LOW-DIMENSIONAL GALERKIN APPROXIMATIONS OF NONLINEAR DELAY 

DIFFERENTIAL EQUATIONS 


MICKAEL D. CHEKROUN, MICHAEL GHIL, HONGHU LIU, AND SHOUHONG WANG 

Abstract. This article revisits the approximation problem of systems of nonlinear delay differential 
equations (DDEs) by a set of ordinary differential equations (ODEs). We work in Hilbert spaces 
endowed with a natural inner product including a point mass, and introduce polynomials orthogonal 
with respect to such an inner product that live in the domain of the linear operator associated with the 
underlying DDE. These polynomials are then used to design a general Galerkin scheme for which we 
derive rigorous convergence results and show that it can be numerically implemented via simple analytic 
formulas. The scheme so obtained is applied to three nonlinear DDEs, two autonomous and one forced: 
(i) a simple DDE with distributed delays whose solutions recall Brownian motion; (ii) a DDE with a 
discrete delay that exhibits bimodal and chaotic dynamics; and (iii) a periodically forced DDE with 
two discrete delays arising in climate dynamics. In all three cases, the Galerkin scheme introduced 
in this article provides a good approximation by low-dimensional ODE systems of the DDE’s strange 
attractor, as well as of the statistical features that characterize its nonlinear dynamics. 


1. Introductuion 

Systems of delay differential equations (DDEs) are widely used in many fields such as the biosciences, 
climate dynamics, chemistry, control theory, economics, and engineering [BGV82,DHL14,DvGVLW95, 
GGS15,GG87,GZT08,HVL93,KS14,Kua93,LS10,Mac89,MN07,RCC+14,Smill,Ste89]. In particular, 
certain DDEs or more general differential equations with retarded arguments can be derived from 
hyperbolic partial differential equations that support wave propagation [CGH12, GT00,HVL93]. 

In contrast to ordinary differential equations (ODEs), the state space associated even with a scalar 
DDE is infinite-dimensional, due to the presence of time-delay terms, which require providing ini¬ 
tial data over an interval [—r, 0], where r > 0 is the delay. It is often desirable, though, to have 
low-dimensional ODE systems that capture qualitative features, as well as approximating certain 
quantitative aspects of the DDE dynamics. 

The derivation of ODE approximations of DDEs involves, in general, two types of function spaces 
as state space: that of continuous functions C'([—r, 0]; M*^), and the Hilbert space L^([—r, 0); M'^). 
The former spaces have been extensively used in the case of bifurcation analysis [GF80, CMP77, 
DG02,FM95,KWVdD78,Nay08,WWP'''94], while the latter are typically adopted in situations where 
quantitative accuracy is an important factor, such as in optimal control [BB78, KS78, BRI84, Kap86, 
KS87,Kun82,IT86,BK79]. 

Within the Hilbert space setting, different basis functions have been proposed to decompose the 
state space; these include, among others, step functions [BB78,KS78], splines [BK79, BRI84], and 
orthogonal polynomial functions, such as Legendre polynomials [Kap86, IT86]. Compared with step 
functions or splines, the use of orthogonal polynomials leads typically to ODE approximations with 
lower dimensions, for a given precision [BK79, IT86]. On the other hand, classical polynomial basis 
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functions do not live in the domain of the linear operator underlying the DDE, which leads to technical 
complications in establishing convergence results [Kap86,IT86]; see Remark 2.1(iii) below. 

In the present article, we propose to avoid these technical difficulties in approximating DDEs as 
systems of ODEs by using an alternative polynomial basis: the elements of this basis belong naturally 
to the domain of the underlying linear operator, but they have not been used in the DDE literature so 
far. The polynomials we shall use are named after Koornwinder [Koo84], who investigated polynomials 
that are orthogonal with respect to weight functions adjoining point masses, as discussed in Section 3 
below. This polynomial basis turns out to be particularly useful not only for the rigorous analysis of 
polynomial-based Galerkin approximations of nonlinear systems of DDEs, as shown in Section 4, but 
also for their numerical treatment, cf. Section 6. 

Useful new properties of the Koornwinder polynomials are identified in Lemma 3.1 for the scalar 
case, and a generalization of these polynomials to the vector case is given in Section 3.3; the latter 
includes the multi-dimensional extension of Lemma 3.1, namely Lemma 3.2. We show that these 
properties are essential for checking key stability and convergence conditions in Lemmas 4.1 and 4.3. 
Standard Galerkin approximation results for abstract nonlinear ODEs in Hilbert spaces are recalled 
in Theorem 4.1 and the rest of Section 4.1. They are then applied, with the help of Lemmas 4.1 and 
4.3, to nonlinear systems of DDEs in Section 4.2. 

Finite-time uniform convergence results are then derived for the proposed Galerkin approximations 
of nonlinear systems of DDEs, subject to simple and checkable conditions on the nonlinear term. 
These conditions are identified in Section 4.2; see Gorollaries 4.2 and 4.3. The results apply to a broad 
class of nonlinear systems of DDEs, as discussed in Section 4.3. 

The proposed framework yields a simple numerical calculation of the corresponding Galerkin ap¬ 
proximations. Their coefficients are easily computable from the original system of DDEs by relying 
on simple recurrence formulas, cf. Proposition 3.1, and by solving upper triangular systems of linear 
equations, cf. Proposition 5.1; see Section 5 and Appendix C. 

Finally, we outline here a useful interpretation of our proposed scheme regarding the finite-dimensional 
approximation of the linear part A of general systems of DDEs, when considered in the framework 
of Hilbert spaces, cf. (4.24). This interpretation relies on a formulation of the evolution in time of 
the initial state {x(0) : 9 G [—u, 0]} as the solution of a partial differential equation (PDE); see also 
Remark 4.1. 

To do so, we first distinguish between the historic part of the evolving state, {x{t + 9) : 9 G [—r, 0)}, 
and the state part, {x{t)}. Denoting by u{t,9) the historic part, one can then rewrite, for instance, 
the simple linear DDE 

(1.1) x = x{t — T), r > 0, 
as the linear PDE 

(1.2) dtu = dgu, —t<9<0, 
with the boundary condition 

(1.3) dtu\g=o = u{t,-T), t>0. 

The key point is that, roughly speaking, the local differential operator v i—)• dgv — obtained as the 
history component of A, and written out explicitly in Eq. (2.8), for instance — is approximated here 
by the nonlocal differential operator 

(1.4) V ^ dgv+ bN{9)(v{-T) - 6»E[-r,0), 

and that bi\f{9) — expressed by means of Koornwinder polynomials, cf. (4.46) — is a bounded oscil¬ 
latory coefficient that vanishes in as —)• oo; see Lemma 3.1. This nonlocal operator is the PDE 
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representation for the history component of our Koornwinder-based Galerkin approximation An given 
in (4.29). 

Note that terms such as 'y(— t)— i® responsible for the nonlocal aspect of (1.4), play an 
important role in the theory of numerical approximation of DDEs; see, for instance, [GZT08, Appendix 
A] and references therein. In particular, this term provides the exact value of the jump associated 
with the boundary condition (1.3). The first such jump occurs at t = 0 in the derivative of solutions 
of Eq. (1.1) that emanate from a constant history^; this discontinuity propagates to higher-order 
derivatives at subsequent, integer multiples of the delay, t = kr, k G Z+. 

The fact that this jump term is weighted by a vanishing term suggests that, for a given degree of 
accuracy, good approximation can be expected when using relatively low-dimensional Koornwinder- 
based approximations, as long as bN vanishes sufficiently quickly. We do not address such numerical 
considerations here; see, however. Table 1 in Remark 4.1 for results in the case of Eq. (1.1). 

Instead, in Section 6, we provide several applications that show the proposed approximation to 
be not only rigorously justified, but very effective in nonlinear cases that yield quasi-periodic and 
chaotic, as well as nearly Brownian dynamics. In each case, low-dimensional ODE systems succeed 
in approximating important topological as well as statistical features of the corresponding DDE’s 
nonlinear dynamics. 

The article is organized as follows. In Section 2, we introduce the functional framework that will be 
adopted in Section 4.2 to recast a system of nonlinear DDEs into an abstract ODE. This framework 
relies on Hilbert spaces endowed with a natural inner product with a point mass. Koornwinder 
polynomials are then introduced in Section 3. The convergence of the Galerkin ODE systems built by 
projecting onto these polynomials to the original DDEs is proven in Section 4. 

We provide explicit expressions of the Galerkin approximation in Section 5 for the scalar case, and 
in Appendix C for nonlinear systems of DDEs. Finally, numerical applications to three nonlinear 
DDEs are provided in Section 6. These applications involve: (i) a simple DDE with distributed delays 
whose solutions recall Brownian motion [Spr07]; (ii) a DDE with a discrete delay that illustrates 
bimodal, as well as chaotic dynamics [Spr07]; and (iii) a periodically forced DDE with two discrete 
delays as a highly idealized model of the El Nino-Southern Oscillation (ENSO: [GZT08, and references 
therein]). In all three examples, it is shown that our Galerkin scheme provides a good approximation 
by low-dimensional ODE systems of the DDE’s strange attractor, as well as the statistical features 
that characterize the associated nonlinear dynamics. 

2. Background and motivation 

We introduce in this section the functional framework that will be adopted in Section 4.2 for the 
derivation of Galerkin approximations of a given nonlinear system of DDEs. Several function spaces 
can be used as a state space for the reformulation of a system of DDEs into an abstract ODE where 
among the most standard ones, those built-up out of the space of continuous functions on the interval 
[—r, 0] play an important role in the DDE theory; e.g. [DvGVLW95,HVL93]. 

In this article, we adopt instead the use of Hilbert spaces which are more classically used in control 
or approximation theory of DDEs; see e.g., [BB78, BHS83, CZ95, Kap86, KZ86, KS87, NY89]. For 
a didactic expository of the associated theory of semigroups for (linear) systems of DDEs in this 
functional setting we refer to [GZ95, Sect. 2.4]; see also [BHS83]. 

More precisely, the following Hilbert product space 

(2.1) H := L2([-r,0);M‘^) X 


^ For instance, if r = 1 and the history is given by {'4>{0) = c, —r < 6 < 0}, then the solution x{t) to Eq. (1.1) is 
equal to c{t + 1) on [0,1]. This discontinuity leads to a jump — dgip\g_^ = c in its time derivative at t = 0. 
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will serve as our state space, and will be endowed with the inner product defined for any (/i, 71 ), (/ 2 , 72 ) £ 
as: 

(2.2) ((/i,7i), (/ 2 , 72 ))w := ^ y (/i( 6 '),/ 2 ( 6 '))d 6 '+ ( 71 , 72 ), 

where (•, •) denotes the Euclidean inner product of 
We will also make use of the following subspace of 

(2.3) V := 0); x 

where r, 0); denotes the standard Sobolev subspace of L^([—r, 0); M'^); see, e.g. [BrelO, 

Chap. 8 ]. This space consists of functions that are square integrable and whose first-order weak 
derivatives exist in a distributional sense and are also square integrable. 

Instead of presenting the general nonlinear systems of DDEs considered in this article (see Section 
4.2), we introduce below a class of scalar DDEs that will serve us to identify within a simple context, 
the issues inherent to the Galerkin approximation of DDEs; see Remark 2.1 hereafter. 


Example 2.1. In this example, we recall how a scalar DDE can be recast into an abstract ODE. For 
simplicity, we will focus on the following autonomous scalar DDE {d= 1): 

(2.4) = ax{t) + hx{t — t) + c f x{s)ds + F(x{t), f x(s)dsy 

dt Jt-T ^ Jt-T ^ 

where a, b and c are real numbers, r > 0 is the delay parameter, and E is a given scalar nonlinear 
function. The case of nonlinear systems of DDEs will be dealt with in Section 4.2. 

The reformulation of Eq. (2.4) into an abstract ODE is classical and proceeds as follows. Let us 
denote by xt the time evolution of the history segments of a solution to Eq. (2.4), namely 

(2.5) xt{0) := x{t + 6), t > 0, 0 g[— r, 0]. 

Now, by introducing the new variable 


( 2 . 6 ) u(t) := (xt,x(t)) = (xt,xt( 0 )), 
Eq. (2.4) can be rewritten as the following abstract ODE: 

(2.7) 

where the linear operator A: D(A) C V —)• "R is defined by 

d+T^ 


— = Au + J-[u), 


( 2 . 8 ) 


[.4T](0) := 


d9 


9 G [-r, 0 ), 

pO 

+ 6 T^(-r) + c / T'^(s)ds, 0 = 0 , 

^ J — T 

with the domain A given by (cf. [Kap 86 , Prop. 2.6]) 

(2.9) D(.4) = |(T^,T^) G L2([-r,0);M) X M : G E^([-r,0);M), lim T^(0) = 

and with the nonlinearity F: Ti ^ Ti defined by 

0, 0e[-r,o), 


( 2 . 10 ) 


[E(T)](0) := 


F 


('I^^/°.'&''(5)dy, 0 = 0, 


VT = (T^,T'^) G n. 


With D{A) such as given in (2.9), the operator A generates a linear Co-semigroup on T-l so that the 
Cauchy problem associated with the linear equation u = Au is well-posed in the Hadamard’s sense; see 
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e.g [CZ95, Thm. 2.4.6]. The well-posedness problem for the nonlinear equation depends obviously on 
the nonlinear term T and we refer to Section 4.2 for a solution to this problem within our functional 
framework; see also [Web76]. 

Remark 2.1. 

(i) It is important to note that when instead of L^([—r, 0); M'^), the space of continuous functions 

X = C'([—r, 0]; endowed with the supremum norm is retained [HVL93], the continuity 

requirement at 0 in (2.9) is naturally satisfied. On the other hand, X is not a Hilbert space and 
the analysis of the adjoint eigenvalue problem [HVL93, Sect. 7.5] is required for the derivation of 
low-dimensional ODE systems which no longer contain memory terms [WWP'’'94]. By working 
within the framework of Hilbert spaces we avoid technicalities inherent to the analysis of this 
adjoint problem. 

(ii) When we consider the Hilbert space Td, a natural choice of set of functions to decompose the 
solutions of (2.7) is constituted by the eigenfunctions of the operator A with domain D{A). 
When A does not contain distributed delay terms, these eigenfunctions are well-known and 
can be found in e.g. [CZ95, Thm. 2.4.6]. In case where the eigenvalues of A are all simple, 
this set of eigenfunctions actually correspond to the set S of eigenfunctions in C'([—r, 0]; M'^) 
[HVL93, Thm. 4.2, p. 207]. The latter set may fail however in approximating continuous 
functions [HVL93, Cor. 8.1, p. 222] and can be even finite-dimensional [HVL93, p. 220] which 
limits seriously its usage in practice^ if for instance snippets of solutions to Eq. (2.7) are 
spanned by elements outside of 

(iii) Due to the aforementioned limitations of the eigenfunctions, other basis functions are often 
used for the derivation of ODE systems to approximate the dynamics of the underlying DDE. 
Choices proposed in the literature include step functions [BB78,KS78], splines [BK79,BRI84], 
and orthogonal polynomial functions such as Legendre polynomials [Kap86, IT86] 

In most of the cases, a version of the Trotter-Kato theorem (see e.g. [Paz83, Thm. 4.5, 
p. 88]) is typically used to obtain finite-time uniform approximation results of the semigroup 
generated by A. In the cases of step functions and splines, the conditions required in the 
Trotter-Kato theorem (see e.g. Conditions (Al) and (A2) in Theorem 4.1 below) have been 
analyzed in [BB78] and [BK79]. 

Eor the case of Legendre polynomials, technical complications have been encountered to 
check these conditions either in the setting of Galerkin approximation [Kap86] or in the setting 
of tau-method [IT86] largely due to the fact that the basis functions do not live in the domain 
of A. As noted in [Kap86, p. 168] or in [IT86, Sect. 5], either Xj\f <f_ D{A) or Htv is not 
orthogonal for the polynomial functions considered in [Kap86] and [IT86], respectively. 

On the other hand, at a given precision, the use of polynomial basis leads typically to ODE 
approximations with lower dimensions when compared with those built out of step functions 
or splines [BK79,IT86]. □ 

The problems discussed in (iii) of the above remark already encountered in the linear case, have 
limited the applications of polynomial basis for the approximation of nonlinear systems of DDEs. The 
above discussion leads naturally to the question whether there exists an orthogonal polynomial basis 


^for the purpose of low-dimensional approximations. 

^See however [CZ95, Thm. 2.5.10] for a sufficient condition for the set of (generalized) eigenfunctions to be dense in 
T-i still for the case when A does not contain distributed delay terms. 

^It is also worth mentioning the more recent works [Vyal2,WC05], in which interesting approximation schemes based 
on linear and sine functions have been proposed for the case of state dependent delays, and for which successful numerical 
performances have been reported although rigorous convergence results seem still to be lacking, within this approach. 
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for which standard approximation results for abstract nonlinear systems such as recalled in Theorem 
4.1 below, could be applied to the case of nonlinear systems of DDEs. 

The next section introduces orthogonal polynomials that will allow us to answer this question by 
the affirmative, leading to direct and explicit formulas for the rigorous Galerkin approximations of a 
broad class of nonlinear systems of DDEs; see Sections 4.2 and 5. As explained next, the key is to 
seek for polynomials that live in the domain of A, which is achieved here by seeking for polynomials 
to be orthogonal for the inner product (2.2) with a point mass. 


3. Orthogonal polynomials for inner products with a point mass 
The inner product given in (2.2) is naturally associated with the measure 

(3.1) v{d6) = d9 + 6o, 

where 5q denotes the Dirac measure concentrated at 6 = 0. 

Orthogonal polynomials with respect to the Lebesgue measure d6 or measures having a smooth 
density with respect to it, has a long history [Sze75]. The study of orthogonal polynomials with 
respect to a measure including a point mass such as given by (3.1) has been studied only lately [Ism05, 
Chap. 2.9]. It was in particular noticed that orthogonal polynomials with respect to such a measure 
can be expressed in terms of polynomials orthogonal with respect to the smooth part of the measure; 
see [Uva69] for an early contribution on the topic. 

Koornwinder in [Koo84] dealt with the case of orthogonal polynomials on [—1,1] associated with 
measures given by 

(3.2) P(dx) = 2»+f^+i^a + lW + 1) ~ ^ ^ «,/3> -1, 

i.e. associated with measures having a Jacobi weight on [—1,1] with two point-masses added to the 
extremities of the interval. 

Although many properties — such as three-term recurrence relationships or differential equations 
satisfied by such polynomials — remain valid in the case of a measure with a point mass, subtle but 
important qualitative and quantitative differences arise. For instance, [AMR97, Thm. 3 c)] shows that 
the zeroes closest to 1 of polynomials orthogonal with respect to the measure u given in (3.2) converge 
to 1 faster than those associated with the standard Jacobi polynomials. 

It is our goal to show that orthogonal polynomials with respect to the measure u in (3.2) allows us 
to work within a simple and more direct framework than those found in the literature, for building 
Galerkin approximations of DDEs. Indeed, the approximation of DDEs by systems of ODEs built from 
orthogonal polynomials were not, so far, relying on classical Galerkin schemes as noted in [Kap86, 
p. 168] or in [IT86, Sect. 5]. 

The results given below correspond to the case a = /3 = M = 0, and = 1 considered in [Koo84]. 


3.1. Koornwinder polynomials. We recall next from [Koo84, Eq. (2.1)] the following sequence of 
Koornwinder polynomials {Kn} that can be built from the Legendre polynomials Ln according to 


(3.3) 


Kn{s) —(1 -|- s)—L^(s) -|- (n^ -\- n -\- V)Ln{s), s G [~1,1], u G N. 


As recalled above, this polynomial sequence is known to be orthogonal when a Dirac point-mass at 
the right endpoint, Ji, is adjoined to the Lebesgue measure [Koo84], in other words 


(3.4) 


Knis)K^is)dfi{s) = ^ 1'^ Kn{s)Km{s)dx + K„(1)K^(1) 


= 0, if m 7 ^ n. 
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This orthogonality property and the main properties satisfied by {K^} on which we will rely on, are 
summarized from [Koo84] in the proposition below. 


Proposition 3.1. The polynomial Kn defined in (3.3) is of degree n and admits the following expan¬ 
sion in terms of the Legendre polynomials: 

n—1 

(3.5) Kn{s) = — y~^ (2j' + l)Lj{s) -|- {v? + 1)L,2 (s), n G N; 

i=o 

and the following normalization property holds: 

(3.6) l^n(l) = 1) re G N. 

Moreover, the sequence given by 

(3.7) {/C„ := (iL„,iL„(l)) :reGN} 


forms an orthogonal basis of the product space 

(3.8) T := L2([-1,1);M) X M, 


where £ is endowed with the following inner product: 

(3.9) {{f,a),{g,b))£ = ^ j ^f{s)g{s)ds + ab, {f,a),{g,b)e£. 

Moreover | \\lc\s } ^ Hilbert basis of £ where the norm ||/C„||£- of induced by {■,■)£ 

possesses the following analytic expression: 


(3.10) 


W^nWe 


(re2 + i)((re +1)2 + 1) 

2re + 1 


re G N. 


Proof. Based on (3.3), the proof consists essentially of algebraic manipulations relying on the following 
standard properties of the Legendre polynomials [STWll, Sect. 3.3]: 

• Orthogonality: 


(3.11) 


/ 7/ni(s)Ln(s)dx — bmni 

1-1 2re + l 


where 6mn denotes the Kronecker delta. 


rer, re G N, 


• Normalization: 


(3.12) L„(l) = 1, reGN. 

• Three-term recurrence relation: 

(3.13) (re + l)L„+i(s) = (2re + l)sL„(s) - reL„_i(s), s G [-1,1], re > 1, 
where the first two Legendre polynomials are given by 

(3.14) Lq = 1 and Li{s) = s. 

• First order derivative recurrence relation: 


(3.15) ^(,)= ^(2A: + l)Lfc(s), 

k^In 

where 

(3.16) /„ := {/c G N : 0 < A: < re — 1, /c + re is odd}. 
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Standard density arguments, outlined in Appendix A, allow us then to conclude the proof. □ 


3.2. Rescaled Koornwinder basis. From the original Koornwinder basis given on the interval 
[—1,1], orthogonal polynomials on the interval [—t, 0 ] for the inner product (2.2) can now be easily 
obtained by using a simple linear transformation T defined by: 

26 

(3.17) T: [-r,0] ^ [-1,1], 6^1 + —. 

T 

Indeed, for Kn given in (3.5), let us define the polynomial by 

K-: [-r,0]^M, 

(3.18) / 2e\ 

9^Kn[l + —), neN. 

Since the sequence {/Cn = (Kn, Kn(l)) : n G N} forms an orthogonal basis for £ (cf. Proposition 3.1), 
it follows then that the polynomial sequence 


(3.19) {/C);:=(iF;,77^(0)) :nGN} 

forms an orthogonal basis for the space % = L?‘(\—t, 0); M) x M endowed with the inner product (•, 
given in (2.2) for d = 1. 

Since A'n(l) = 1 from (3.6), we have 

(3.20) Km = 1. 

Moreover, by applying the transformation T, we get trivially that 


(3.21) 


\\lCl\\H = \\lCn\\E. 


We have then the following fundamental lemma. 

Lemma 3.1. The rescaled Koornwinder polynomials {Arj}j>o satisfy the following properties: 


(3.22) 


and 


(3.23) 


OO 

^ ||/C 

j=o " . 




= 0, in the sense. 


OO .. 


= 1 . 


Moreover, each function in LP‘(\—t, 0]; M) enjoys the following decomposition in terms of the Koorn¬ 
winder polynomials iFJ: 


OO 


/ = E 

j=o 




V/GL2([-r,0];M). 


(3.24) 
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Proof. For any G V., we have^ 


(3.25) 


||rr||2 

j=0 IIS'll-H 

OO - 

j=0 




ll/cjll?,- 


Now, let to be the zero-function on [—t, 0] and to be 1. For such a 'h, by equalizing 
respectively the ZD-components and S'-components of the RHS and LHS of (3.25), one then obtains 
from (3.20) that 


(3.26) 

and 

(3.27) 


E 


k: 




= 0, in the sense, 


i=o ii'E'l-H 


E 


Go lIMIli 


= 1 . 


The decomposition of functions given in (3.24) follows directly from (3.25) by considering T := 
(/, 0) G PL. Again, the equality holds in the sense. 

□ 


As an illustration of the identities (3.22) and (3.23), Figure 1 displays numerical computations of 
N-l K] 


the partial sum HtrT]t 2 for A" = 20 and N = 60, in the case r = 0.5. 


Sum of the first N rescaled Koornwinder polynomials 



Figure 1. Sum of the first N rescaled Koornwinder polynomials: blue curve corresponds to A = 20, 
and red curve to A = 60. 


®Note that the equality in (3.25) holds in the sense that T — y 




UK 






j=o ||k: 


AT 


Ii 2 


= 0and 




j IIK 


AJ 


= 0, which is equivalent to 


■i=0 IIK’ 


iiE 


= 0 . 
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Remark 3.1. 

(i) Note that the continuity condition, lini 5 i_,.o- required in (2.9) in order that 

'k G D[A), is here naturally satisfied by the Koornwinder basis function /C)) = {K^, K^{0)). It 
constitutes thus, for the inner product (2.2), an orthogonal polynomial basis whose elements 
live in the domain of the linear operator A given in (2.8). 

As explained at the beginning of Section 3, the key element for such a construction relies on 
the inclusion of a point mass adjoined to the continuous part of the measure. When this point 
mass is absent, the corresponding orthogonal polynomials are (rescaled) Legendre polynomials. 
The associated basis in this latter case is given by (cf. [Kap86]) 

(3.28) OS := {lAi := (0^, 1)} U := (L;_ 2 , 0) | n = 2, 3, • • • }, 

where 0-^ denotes the zero function on Ti, and LJ) is the Legendre polynomial of degree n 
defined on the interval [—r, Ol. Clearly, none of the elements in 53 belongs to D(A) since 
lime^o- ^n(^) / 0- 

(ii) The fact that the Koornwinder basis functions live in D{A) allows us to construct standard 
Galerkin approximations; whereas, extra correction terms are required in the Galerkin ap¬ 
proximation built from the Legendre-based basis given in (3.28) (see e.g. [Kap86, p. 169]). 
Moreover, technical complications such as pointed out in Remark 2.1 in) do not take place for 
the case of Koornwinder basis. Indeed, it will be shown in Section 4.2 that the properties of 
the Koornwinder polynomials such as summarized in Corollary 3.1 as well as the vectorized 
version given by Corollary 3.2 below, turn out to be sufficient to obtain finite-time uniform 
approximation results of the semigroup generated by the linear operator A] see Lemmas 4.1 
and 4.3. 

(iii) It is also worth mentioning that Corollary 3.1 and Corollary 3.2 as well as the rigorous con¬ 
vergence results presented in Section 4.2 are not limited to the case of Koornwinder basis 
constructed here. Given any polynomial basis on [—r, 0] that are orthogonal with respect to 
a measure of the form u{d9) = dp{9) + Jq with p being a positive non-decreasing function on 
[—T, 0], the aforementioned results would still hold. We refer to [Uva69] for the construction of 
such polynomials when orthogonal polynomials with respect to u{d9) = dp{9) are known. □ 

3.3. Vectorization of Koornwinder polynomials. We introduce here a generalization of the 
Koornwinder polynomials that will turn out to be useful for the approximation of nonlinear DDE 
systems. 

The purpose is here to build from the Koornwinder polynomials introduced above, linear subspaces 
'Hn that approximate 7i := L^([—r, 0); M'^) x M^, for d> 1. 

Each function 4' in "R has here d-components that can be, each, approximated by a series of 
Koornwinder polynomials as in (3.25). If we restrict such an approximation to the first N Koornwinder 
polynomials, T-Ln becomes then an x d-dimensional subspace; see (4.26) below. 

Our goal is also here to introduce a vectorization of Koornwinder polynomials which allows for a 
natural extension of Lemma 3.1 in the case d > 1. This extension of Lemma 3.1 will be particularly 
useful to provide finite-dimensional approximation of the linear part of systems of DDEs; see Lemma 
4.1. 

To do so, given j G {I,-’’ ^^d}, we can associate a Koornwinder polynomial of degree jq G 
{0, • • • ,N — 1}, as follows 


( 3 . 29 ) 


j = djq + jr, 
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where G {1, • • • , d} is given by 
(3.30) jr := 


mod(j, d), if mod(j, d) ^ 0, 
d, otherwise. 

Let us introduce now the following d-dimensional mapping from [—r, 0] to 


(3.31) 


Ky(0):=( O,--- ,0 ,iLa0), 0,---,0)*^ 0G[-T,O]. 


The vector KJ(0) is then nothing else than a d-dimensional canonical vector whose j*^-entry is 
given by the value at 0 of the (rescaled) Koornwinder polynomial of degree jq] the integers jq and 
jr being related to j according to (3.29)-(3.30). Based on these vectorized (rescaled) Koornwinder 
polynomials KJ, we also introduce 

(3.32) KJ:= (KJ,KJ(0)), j > 1. 

In the remaining part of this section, we summarize some key properties of KJ and KJ for later 
usage. Hereafter, we use Tii to denote the space V. defined in (2.1) for the case d = 1, i.e., 

(3.33) Til = 0); M) X M, 

which is again endowed with the inner product given in (2.2) (still with d = 1). 

Since the sequence {/CJ = {KJ,KJ{0)) : j G N} forms an orthogonal basis for T-Li (cf. Section 3.2), 
one can readily check that {KJ : j G N*} forms an orthogonal basis for the space Ti. 

Note also that 


(3.34) IIKJII^ = ||/CJJ|^„ jGNL 

Given this vectorization of Koornwinder polynomials, we can now formulate the following extension 
of Lemma 3.1 that summarizes the key properties of the Kj’s which will be used for the rigorous 
approximation of nonlinear systems of DDEs such as described in Section 4.2. 


Lemma 3.2. The vectorized rescaled Koornwinder polynomials {KJ}j>i satisfy the following prop¬ 
erties: 


(3.35) 

and 

(3.36) 


^'^’^ J(0))t^t _ n T2n ^n\.Tn>d 


^ ii 2 KJ = 0 in the L^([—r, 0); M^) sense, Va E 


ti 


“(a,KJ(0)) 

Z. \\jrrn2 K^(0) = «. VaG 

i=l IlSgllWl 


Moreover, each function in L^([—r, 0]; M*^) enjoys the following decomposition in terms of the vec¬ 
torized Koornwinder polynomials KJ: 


(3.37) 



and the following identity holds: 


(3.38) 
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Proof. The above identities can be obtained by using the same type of reasoning as given in the proof 
of Lemma 3.1 for the scalar case. 

Indeed, by noting that {KJ : j G N*} forms an orthogonal basis of H, any T G H admits the 
following decomposition: 


(3.39) 


^ = > —— 


oo 

E 




j 


iicj 


jq ''Hi 


where we have used the identity (3.34) in the last equality above. 

Now, let G L^([— r, 0]; M'^) to be the zero-function and to be an arbitrary vector a G 
For such a T, by equalizing respectively the H-components and 5-components of the RHS and LHS 
of (3.39), we obtain respectively (3.35) and (3.36). 

The identities (3.37) and (3.38) also follow directly from (3.39) by considering = / and = 
0 G 

□ 


4. Galerkin approximation: Rigorous results 

In this section, we establish the convergence of the Galerkin scheme based on the rescaled and 
vectorized Koornwinder polynomials of Section 3.3. These convergence results apply, as we shall see, 
to a broad class of nonlinear systems of DDEs. 

As mentioned in the Introduction and in Remark 2.1-(iii), the advantage of the Koornwinder basis 
relies on the facts that the constitutive basis functions are orthogonal and belong each to the domain 
of the linear operator associated with a given DDE. In particular, there is no discontinuity at the right 
end point for each basis element, by construction; see Section 3. Thanks to these properties of the basis 
functions, convergence results for the associated Galerkin systems can be derived in a straightforward 
fashion (see Corollary 4.1) and under useful criteria on the nonlinear terms (see Corollaries 4.2 and 
4.3), compared to other Galerkin schemes built from other bases; see, e.g., [Kap86,KS87,Vyal2,WC05] 
and references therein. 

In the following, we first present in Section 4.1 a general convergence result for Galerkin approxima¬ 
tions of abstract nonlinear ODEs in Hilbert spaces by relying essentially on the theory of semigroups 
and the Trotter-Kato theorem [Paz83, Thm. 4.5, p. 88]. The result is then applied to the DDE context 
in Section 4.2. General examples are provided in Section 4.3. 

4.1. Galerkin approximations of nonlinear ODEs in Hilbert spaces. We first present a general 
convergence result for Galerkin approximations of abstract nonlinear differential equations in a Hilbert 
space X, endowed with a norm || • ||x- The mathematical setting is somewhat classical but we recall 
it below for the reader’s convenience and later use. 

In that respect, we assume in this Section the linear operator C to be the infinitesimal generator of 
a Go-semigroup of bounded linear operators T(t) on X. Recall that in that case the domain D{C) of 
L is dense in X and that £ is a closed operator; see [Paz83, Cor. 2.5, p. 5]. 

Under these assumptions, recall that there exists M > 1 and w > 0 [Paz83, Thm. 2.2, p. 4] such 
that 

(4.1) \\T{t)\\<Me‘^\ t>0, 

where || • || denotes the operator norm subordinated to || • ||x- 




GALERKIN APPROXIMATIONS OF NONLINEAR DELAY DIFFERENTIAL EQUATIONS 


13 


We are concerned with finite-dimensional approximations of the following initial-value problem: 


(4.2) 


— = Cu + g{u), 
ri(0) = uo, 


where uq G W. 

A mild solution of (4.2) over [0, T], will be any function u G C{[0,T], X) such that for uq G X, 

(4.3) u{t)=T{t)uo+ f T{t — s)g{u{s))ds. 

Jo 

Let {X]\f : G N} be a sequence of subspaces of X associated with orthogonal projectors 


(4.4) 


LtAT : X —)• Aat, 


such that 


(4.5) IIIlAr—Idxll -> 0, 

N—^OO 

and 

(4.6) XNCD{£),yN. 

The corresponding Galerkin approximation of (4.2) associated with is then given by: 

du]\f 

(4.7) ^ 


= CnUn + UNg{uN), 


where 

(4.8) 


Un{0) = nATtio, Uo G X, 
jCtv •= LItvTIItv : X —> Xj^. 


In particular, the domain D{C]\f) of Tat is X, because of (4.6). 

As we will see in Section 4.2, the choice of vectorized Koornwinder polynomials as a basis function 
will allow us to define subspaces Xn naturally associated with orthogonal projectors Hat that sat¬ 
isfy the above properties in contrast to other polynomial functions used for (non-standard) Galerkin 
approximation or other Legendre-tau approximations of systems of DDEs used so far; see e.g. [IT86, 
Kap86]. See also Remark 2.1-iii). 

These nice properties will allow us also to rely on the following general convergence result regarding 
standard Galerkin schemes, for the case of nonlinear systems of DDEs; see Section 4.2 below. 


Theorem 4.1. Let £ and {XAr}Af>o be as described above. Assume furthermore the following set of 
assumptions: 

(Al) Eor each iV G N, the linear flow : Xn —t Xat extends to a Co-semigroup T^it) on X. 
Eurthermore the following uniform bound is satisfied by the family {Tj\f{t)}]sf>o^t>o 

(4.9) ||rjv(t)|| < Me‘^^ N>0, t > 0, 

where ||rY(i)|| = sup{||rAr(t)x||A:, Iklk < l,a; G X}. 

(A2) The following convergence holds 

(4.10) lim \\Cn(I) — CcjWx = d, 

N—^oo 

(A3) g is globally Lipschitz. 
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Then for any uq G X, there exists a unique mild solution of (4.2) and such a solution can be ap¬ 
proximated uniformly on each bounded interval [0, T] by the sequence {t i—)■ U]sf(t]Il]sfUo)}N>o of mild 
solutions obtained from (4.7), i.e.: 

(4.11) lim sup ||uAr(t;n 7 vuo) — ^(i;'Uo)||x = 0, V T > 0. 

N^oo tg[o,T] 

Proof. Recall that the existence and uniqueness of solutions to Eq. (4.3) emanating from any initial 
data uq G X can be proved by a fixed point argument in C'([0,r],X) as in the proof of e.g. [CH98, 
Prop. 4.3.3], by relaxing the semigroup of contractions requirement therein to the Co-semigroup setting 
adopted here; see also [Lun04, Thm. 6.1.1]. 

Given uq G X, let u be thus the unique mild solution of Eq. (4.2). By the variation-of-constants 
formula applied to Eq. (4.7) we have on the other hand, for 0 < t < T, 

(4.12) UN{t) = + [ e^'^^^-^'>UNg{uN{s))ds. 

Jo 

Then UAr(t) = u{t) — u^it) satisfies 

VN{t) = T{t)uo - + f T{t - s)g{u{s))ds - f e^^*^*“^^njv^(uAr(s))ds 


(4.13) 


Let us introduce 


(4.14) 


= T{t)uo - e^^^UNUo + / {T{t - s) - e^^J-^^UN)g{u{s))ds 

Jo 

+ [ - g{uN{s)))ds. 

Jo 

rN{s) := llu(s) - UAr(s)llx, 

eAr(uo) := sup llT(f)uo - e^^^IlArUolk, 

i6[0,r] 

dNis) := sup ll(r(t - s) - e'^^(‘"*)nAr)^(u(s))llx. 
te[s,T] 


(4.15) 


We obtain then from (4.13) that 

rN{t) < eN{uo) + f dN{s)ds+ f lle^^(‘“®)nAr(^(u(s)) - ^(uAr(s))) JJxds 

Jo Jo 

eNiuo)+ [ dN{s)ds + MLip{Q) f e‘^J~^''rN{s)ds 
Jo Jo 

<^n{uo)+ [ dN{s)ds + MLi-p{g)e‘^'^ f rN{s)ds, 

Jo Jo 

where we have used the global Lipschitz condition on Q and (4.9) to derive the second inequality. 
It follows then from Gronwall’s inequality that 

rT 


(4.16) 


rN{t) < (eNiuo) + J dNis)ds)e 


MUp{g)Te‘^ 


vt G [o,r]. 


We are thus left with the estimation of eAr('Uo) and dN{s)ds as N ^ oo. The assumptions (Al)- 
(A2) allow us to use a version of the Trotter-Kato theorem [Paz83, Thm. 4.5, p.88]® which implies 


^Recall that because £. is the generator of a Co-semigroup T{t) on X, it satisfies ||r(t)|| < Me“*, and as a consequence 
the resolvent set of C contains the interval ]cj,oo[; see [Paz83, Thm. 5.3 p. 20]. In particular, for any / € R and any 
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together with (4.5) that 

(4.17) lim e^^^UN^ = T{t)cj), V 0 G X, 

N^oo 

uniformly for t in bounded intervals. 

It follows that 


(4.18) 


lim eAr(Mo) = 0, V uq £ X, 

N^OO 


and that (In converges point-wisely to zero on [0,T], i.e. 

(4.19) lim d7v(s) = 0, VsG[0,r]. 

Af—>-oo 


On the other hand, from (4.1), (4.9), and (A3), we get 

||{r(i - s) - A»i‘-)nA,)e(<.W)IU < 2Afe"C-*>||e(u(»))|Lv 

(4.20) , , 

<2Me‘^(^-^\Up{g)\\u{s)\\x + \\gm\x), 

which implies 

(4.21) dN{s)<2Me^^{Up{g)\\uis)\\x + \\gm\x), VsG[0 ,r]. 

Since u G C'([0,T],X), s i—>■ ||u(s)||x is integrable on [ 0 ,r], and the Lebesgue’s dominated convergence 
theorem allows us then to conclude from (4.19) and (4.21) that 

(4.22) lim [ dN{s)ds = 0. 

Jq 

The desired uniform convergence estimate (4.11) is then trivially obtained from (4.16). 

□ 


4.2. Galerkin approximations of nonlinear systems of DDEs. In this section, given the Hilbert 
product space 

n := L‘^i[-T, 0); M'^) x M'^, d> 1, 

endowed with the inner product (2.2), we restrict our attention to the following abstract ODE: 

(4.23) ^=Au + X(u), 

dt 

where X is a nonlinear operator that will be specified later on, and where — given L^, a bounded 
linear operator from i7^([—r, 0); M'^) to and, Ls, a bounded linear operator from to — the 
linear operator A is given by 


(4.24) 


[A^m := 


< de ’ 

+ Ld^^, 

\ 


9 G [-r,0), 


6 » = 0 , 


for any T = (4'^, T'^) that lives in the domain, D{A), dehned as 

(4.25) D{A) := G X : G X^([-r,0);M'^), lim T^(0) = 


Such an abstract setting arises naturally in the reformulation of a broad class of nonlinear systems 
of DDEs as an abstract ODE in 77; see e.g. [BHS83, CZ95]. Examples of operators depending 
explicitly on the delay r are given below; see (4.47). 


A > o), the equation {XI — £)x = f possesses a unique solution x € D{£), which implies in particular that {\I — £)D{£) is 
dense in X as required by the version of the Trotter-Kato theorem used here. This explains why this density requirement, 
consequence of our working assumptions, is omitted in the formulation of Theorem 4.1. 
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It is well-known that under these assumptions, the operator A defines a Co-semigroup on % [BHS83, 
Thm. 2.3], and in particular A is dense in % and is a closed operator. 

We turn now to the definition of the subspaces Ww and Hat of the previous section. For each 
positive integer N, we define the A^d-dimensional subspace 1-Ln C to be spanned by the first Nd 
vectorized Koornwinder polynomials introduced in (3.32), namely 

(4.26) Un = span|]K[, • • • , . 

As noted in Section 3.3, these polynomials are orthogonal for the inner product with a point mass 
such as defined in (2.2). 

The subspace Hat is thus naturally associated with an orthogonal projector ITat, as required in the 
previous section. The approximation property (4.5) is satisfied due to the density arguments outlined 
in Appendix A. 

Recall finally that by construction KJ G D{A) for any j G N*, and therefore 

(4.27) -Hn C D(A). 

The corresponding A^-dimensional Galerkin approximation of Eq. (4.23) reads then: 

(4.28) = Anun + Up^T{un), 
with 

(4.29) An := nArAIlAr, 

which is therefore well defined on T-L because of (4.27). 

We are now in position to check Conditions (Al) and (A2) of Theorem 4.1. To check Condition 
(Al), we will make usage of the following extension of the linear flow 

(4.30) TN{t)u = C^^^HnU + {I — nAr)M, u G "R. 

Such an extension leads naturally to a Co-semigroup on T-L. The stability condition (4.9), will require 
however some specifications of the operator that will be made clear later. 

Condition (A2) can be however checked in the general setting by making an appropriate use of the 
properties of the vectorized Koornwinder polynomials summarized in Lemma 3.2. More precisely, 

Lemma 4.1. Let T-Ln be the subspace defined in (4.26). Then for A defined in (4.24) and An defined 
in (4.29) associated with the orthogonal projector Hat onto Hn, we have 


(4.31) 


lim IIAat^'- = 0, VTgT>(A). 


Proof. By construction KJ G D{A) for each j G N*. Since ■ j G N*} forms a Hilbert basis of 

Pi, it suffices to show that 


(4.32) 


lim IIAat'I'— 

N—^oo 


0 , tg \Jnk. 

k>l 
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We recall from (3.34) that IIIKJH-^ = for all j G N. It follows then that the orthogonal 

projector IlAr associated with the subspace TIn takes the following explicit form: 

= E 

j=l 
Nd 


(4.33) 




i=i 






Pn Qn 




yP'N <1 'nJ ’ 

where the operators Pn,p'j\[,Qn,Qn are defined as following: 


(4.34a) pjv :i'([-r,0];M'')^L2([-T,0];M''), 


(4/^,Kn^2 




iV., 5 


(4.34b) 

(4.34c) 

(4.34d) 




Nd /,j,D 




qn '■ 






('k^,Ky( 0 )). 


Nd 


T ||2 ’ 


Qn 


^ E iirx 12 KJ( 0 ). 

j = l 


In the following, we arbitrarily hx <I> G T-Lk for some integer A: > 0. Now let us choose N such that 
Nd > k, then = *1*; and we get for each such N 


(4.35) = IItv^IItv^) = = 

We obtain then 

(4.36) {A-An)<^ = 


^Pn%^^ + Qn^Ls^^ + 

KP'Nm^^ + QNiLs^^s + LD'^D^, 


, if Nd > k, 


(I^ - Pn)^^^ - qN{Ls^^ + Ld<^^) 

+ (/^ - q^j^){Ls<^>^ + 

where and denote the identity maps on L^([—r, 0]; M*^) and respectively. 

We show below that the RHS of (4.36) converges to zero. Let us begin with the term . 

Note that by comparing the definition of pTv give by (4.34a) and the decomposition of L^([—r, 0]; M*^) 
functions given by (3.37), we see that for each / G L^([—r, 0];M'^), the term p^f is the partial sum of 
the hrst N terms in the corresponding decomposition. It follows then that 

tD 


hm ||(/^-Py)/||l 2 =0, V/gL^([-t,0];M'^). 

N^oo 


(4.37) 

Since <I> G Tik C D{A), it holds that G L^([—r, 0]; M'^). We obtain then from (4.37) that 

(4.38) 


lim 

N^OO 




L 2 


= 0 . 
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We turn now to the estimates for q]\f{Ls^^ + Ld^^). By the dehnition of qn in (4.34c), we get 

Nd 

(4.39) 




j=l 


T ||2 
jq ''Hi 


It follows then from the identity (3.35) that 


(4.40) 


lim 

N^OO 


qN{Ls^^ + Ld^^)\\l‘^ = 0 . 


For the term since 0)j h follows from the definition of p'j^ given i 

(4.34b) and the identity (3.38) that 


m 


(4.41) 


lim 

N^OO 




= 0 , 


where | • | denotes the Euclidean norm of W^. 

By using the identity (3.36), we also get 

(4.42) lim I (I^ - g)v) (^5$^ + Ln^^) I = 0. 

N^oo 

Now, by using the estimates (4.38), (4.40), (4.41), and (4.42), we get from (4.36) that 

(4.43) 

and (4.32) follows. 


lim ||(^-^Ar)4>||^ = 0, 
N^oo 


□ 


Remark 4.1. We explain here how the truncated linear operator An defined in (4.35) is related to 
an interesting class of nonlocal linear PDEs. Eor the sake of clarity, we discuss the case d = 1. Eor 
convenience, let us write v{9) = <h^(0) and, recalling e.g. Eq. (1.2) in the Introduction, replace d'^v/dO 
by Vo in (4.35). 

One then obtains that, when v gT-Ln, 


(4.44) 


ue(0) 


(pNVe\ ^ ( ve '\ _ 

[pN^eJ \ve{0)) ^ ||/C„||^ 


A-l 

E 


ic: 


Next, we use the expressions of An, Pn and qn — given, respectively, in (4.35), (4.34a) and (4.34c) 
— to note that the H-component v of any solution u of 

dtt 

— = Anu, 
dt 

which emanates from initial data taken^ in T-Ln, satisfies the following nonlocal linear PDE: 

(4.45) dtv = dev + bN{0) (^Lsv{t, 0) + Ldv - dev\Q^^ 
here 

(4.46) 


Af-l 


bN{9) = ^ 


Km 


and the rescaled Koornwinder polynomials are given by (3.18), since 4 = 1. We see therewith 
that the Galerkin scheme used herein introduces a nonlocal perturbation term with respect to the 


'For such initial data, the solution stays in Wjv, by the definition of .4 at. 
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L)-component of A given in (4.24). This perturbation term results from the difference between the 
5-component of A and the derivative at 0, when applied to functions in Tiw- 

From Lemma 4.1 above and Lemmas 4.2 and 4.3 below, one can infer by the Trotter-Kato theorem 
that the effects on the solutions of Eq. (4.45) of this nonlocal perturbation — which vanishes as 
N —^ oo, due to (3.22) — do not lead to a degenerate situation and that actually these solutions 
converge over hnite intervals to those of the local PDE, dtv = dgv. This nice convergence is due to 
the key properties of the Koornwinder polynomials, as summarized in Lemma 3.1 for d = 1, and in 
Lemma 3.2 for the multidimensional case; see also Fig. 1 for the nature of the approximation at 0 = 0. 

To conclude this remark, we return now to the discussion in the Introduction concerning the ap¬ 
proximation of discontinuities that arise, for instance, in the first-order derivative of a DDE’s solution, 
cf. [GZT08, Appendix A and references therein]. 

In Table 1, we report the corresponding differences over the interval [0,2] between the analytic 
solution of Eq. (1.1) with r = 1 and history x{t) = 1, on the one hand, and low-dimensional Galerkin 
approximations obtained by application of the formulas derived hereafter in Section 5, on the other. 

Table 1. Errors in Galerkin approximation of Eq. (1.1) 


N 

Max. error in Galerkin solution 

Max. error in l^^-order derivative 
of Galerkin solution 

4 

6.9 X 10-® 

5.9 X 10-2 

8 

9.3 X 10"^ 

2.2 X 10-2 

16 

2.3 X 10"^ 

1.1 X 10-2 

32 

9.0 X 10"® 

5.4 X 10-® 


The second column of this table is obviously consistent with the rigorous convergence result of 
Corollary 4.1 proved below. The third column shows that, furthermore, the aforementioned disconti¬ 
nuities present in the derivative of the DDE’s solutions are well captured by the proposed methodology 
as well. □ 


In the following, we restrict the linear operator A dehned in (4.24) to be such that Ls ■ 
is a bounded linear operator, and L/j is defined by 

(4.47) fO 

^ / C(s)^^(s)ds, 


with i? : —>• M'’* being a bounded linear operator®, and C'(-) G L^([—r, 0); 

In the following preparatory lemma. Lemma 4.2, we recall by means of basic estimates, that the 
existence of w > 0 such that A — ujI is dissipative in Ti, can be guaranteed. This fact will be used to 
establish a stability condition of type (4.9) (with M = 1) for the semigroups T{t) and generated 

respectively by A and its finite-dimensional approximation An', see Lemma 4.3. The proofs of these 
Lemmas are quite straightforward but are reproduced below for the sake of completeness. 


Lemma 4.2. Let A be dehned such as in (4.24) with such as specihed in (4.47) and Lg : 
to be a bounded linear operator. Then 

(4.48) < wllTllI^, VTeD(A), 


®Note that r) is well-defined for 4*^ € ([—r, 0); R'’*), since the latter Sobolev space is continuously embedded 

in the space of continuous functions DO—r, 0];R‘*); see [BrelO, Thm. 8.8]. 
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with® 

(4.49) 




Proof. Let G D{A), then by the definition of A given in (4.24), we have 

1 Z"® /rl+\I/^ \ 

(4.50) {A^,^)n = -J [^^{9),^^{e)y9 + {Ls^^,^^) + {LD^^,^^). 

Note that 


(4.51) 


1 

r 


II ^ d|4/^(0)p 




Using the definition of Lu given in (4.47), we obtain 

+ f C{9)^^{9)d9, 4 /^) 

< |5||4'^(-r)||4'®| + ||C||i2||^^||i2|^^| 

It follows then from Young’s inequality that 


(4.53) 


(Ld^^, 4'^) < (^|^^(-r )|2 + ^|5n4' 


2|,t,S|2 


Note also that 

(4.54) (L54'^,4'^) < |L^||4''^|2. 

Now, by using (4.51), (4.53), and (4.54) in (4.50), we get 

{A^,^)n < (^ + \Ls\ + l\B\^ + l\\C\\h) |4/5p + 

( 4 . 55 ) < (l + ^ + \Ls\ + ^-\B\^ + l\\C\\: 

= (l + ^ + \Bs\ + 2^B\‘^ + ^||C'||^2^ 

leading thus to the desired estimate. 


L 2 


\J/-S'|2 _|_ _||^ 
r 


D||2 
L 2 


|4'| 




□ 


Lemma 4.3. Let A be defined such as in (4.24) with Lu such as specified in (4.47) and L 5 : M'’* —)> 
to be a bounded linear operator. 

Then, the linear semigroups T{t) and T]\f{t) generated respectively by A and An defined in (4.29), 
satisfy 

||r(t)||<e-* and ||T^(t)|| < e‘^*. 


(4.56) 

with u! given by (4.49). 


t > 0 , 


^Throughout this article, we will denote indistinguishably by | • f either the Euclidean norm of a vector in or its 
subordinated (operator) norm, in the case of a d x d matrix. It should be clear from the context which norm is used. 
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Proof. Since T(t) is a Co-semigroup with infinitesimal generator A, we have that T{t)uo G D{A) for 
all uq G D{A), and that 

(4.57) ^T{t)uo = AT{t)uo, yuo^A,t>0-, 

cf. [Paz83, Thm. 2.4 c) p.5]. 

We obtain thus 

(4.58) ^\\T{t)uo\\‘^ = 2{AT{t)uo,T(t)uo)H VuoGO(^), 

where we have used Lemma 4.2 to obtain the last inequality above with cj given by (4.49). 

It follows then from Gronwall’s inequality that 

(4.59) \\T{t)uofn < Vuq G D{A). 

Since D{A) is dense in PL and T{t) are bounded operators on Pi, the estimate (4.59) still holds for 
general initial data in PL, leading in turn to 

(4.60) ||r(t)|| < t>0. 


The estimate for T^v is also trivial and proceeds as follows. First note that by the definition of T/v 
given by (4.30), we have 


(4.61) 


\\TN{t)uo\\\i = (e'^^^IlTvuo + (7 — nAr)tto, e'^^^IlTvuo + (7 — n7v)uo) 

= (e'^^^IlTvUo, e'^^^IlArtto)^ + ((7 — nAr)Mo, (7 — nAr)tto) 


H 




'AnuoWIi + 11(7 - Un)uo\\'^. 


It follows that 
(4.62) 


Note also that 


(4.63) 


f^\\TNit)uofn = 

= 2{ANe'^^^IlNUo, e'^^^IlNUo)'n, \/ uo £ PL. 

{An'^,^)v. = (IlAr^IlArT, 

= (Iliv^nArT, rtArT)-^ + (nAT^nArT, (7 — nAr)4')^ 
= (IlAr^IlArT, IlArT)-^ 

= (-^IlAr'I', nArT)-^ 

< Co'IIIlAr'I'll'^ 

< u;||T||^. 


We obtain then from (4.62) that 

^||Tiv(t)no||?,<2u;||e'^-*n^uo||?, 

(4_64) ^ 2w(||e'^^*nArUo||f^ + ||(7 — nAr)tto||f^) 

= 2 u;||e'^^*n^uo + (7-n^)uo|||^ 

= 2w||TAr(f)tto|lH, V uo £ 77. 


The desired estimate for ||TAr(f)|| can be derived now from (4.64) by using Gronwall’s inequality. 

□ 
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Remark 4.2. Note that the estimate about T/v in (4.56) shows in particular that solutions of (4.45) 
grow at most exponentially with a rate independent of N, and stay uniformly bounded over finite 
intervals. □ 

With these preparatory lemmas, we are now in position to obtain as corollaries of Theorem 4.1, 
the convergence results for the Galerkin approximation (4.28) of d-dimensional nonlinear systems of 
DDEs of the form 

(4.65) ^ = Ls'x.{t) + B-K{t — t) + j (7(5 — t)x(s)ds + F^x(t), y x(s)ds^, 

where F : x —)■ and Ls, B, and C are as given in (4.47). 

We first sate the result for the case of global Lipschitz nonlinearity, keeping in mind that already 
for the case of scalar DDEs (d = 1), chaotic dynamics can take place under such a simple nonlinear 
setting; see Section 6.1 for a numerical illustration. 


Corollary 4.1. Let A be defined such as in (4.24) with Ld such as specified in (4.47) and Lg : 
to be a bounded linear operator. Assume that the nonlinearity W: 77 —)■ 7^ defined by 


(4.66) 


[W(T)](d) := 


0 , 

F(4/^/°^T^(5)d5), 


e E [-r,0), 

d = 0, 


VT = (T^,T^) E 77, 


is globally Lipschitz. 

Then, for each uq € Ti, the mild solution of (4.28) emanating from IItvUo converges uniformly to 
the mild solution of (4.23) emanating from uq on each bounded interval [0,T], i.e.: 


(4.67) lim sup ||uAr(7; IlArUo) — u(7; uo)||w = 0, ^ T > 0, uq £ B. 


Proof. This corollary is a direct consequence of Lemma 4.3 and Lemma 4.1, ensuring respectively. 
Conditions (Al) and (A2) of Theorem 4.1. □ 

In the next two corollaries, we relax the global Lipschitz condition assumed in Corollary 4.1 to a 
local Lipschitz condition in addition to either a sublinear growth for B (see Corollary 4.2) or an energy 
inequality satisfied by W; see Corollary 4.3. 

Corollary 4.2. Let A be defined in (4.24) with Ld specified in (4.47) and L 5 : — )■ to be a 

bounded linear operator. 

Assume that the nonlinearity J- given by (4.66) is locally Lipschitz in the sense that for all r > 0 
there exists L{r) > 0 such that for any Ti and 'i >2 in 77, we have 

(4.68) II^iIIh < r and || 4 ' 2 ||w < r ||W(4'i) - B{^2)\\h < L{r)\\^i - ^2 \\h- 
Assume also that T satisfies the following sublinear growth: 

(4.69) ||-^(4')||w <7 i||^IIh + 72, V4'E77, 

where 71 > 0 and 72 > 0 . 

Then, for each uq E 77, the mild solution of (4.28) emanating from IlArtto and, the 

mild solution u{t;uQ) of (4.23) emanating from uq, do not blow up in any finite time. Moreover, 
U]sf{t;Il]\fUo) converges uniformly to u{t;uo) on each bounded interval [0,T], i.e.: 

(4.70) lim sup \\u]y{t-,Il]yuo) — u{t-,uo)\\'}{ = 0, \/T>0,uo£'H. 
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Proof. Recall that the local Lipschitz condition (4.68) on T ensures the existence and uniqueness of a 
local mild solution u{t;uo) to (4.23) emanating from any uq G PL; see e.g. [CH98, Prop. 4.3.3].^*^ 

By recalling that ||T(t)||'^ < (see Lemma 4.3) and by using the sublinear growth assumption 
(4.69) on J-, we obtain for mild solutions 


(4.71) 


\uit)\\H <\\T{t)uo\\n+ / l|r(i - s)l^(u(s))||-Hds 

Jo 

rt 


< e' 


Ujt I 


uo\\'H + J *^(7ilk(s)ll'H+ 72)ds 


Jo 


U) 


where the positive constant to is given by (4.49). 

A simple multiplication by to both sides of (4.71), leads then trivially to 


(4.72) 


3-^1n(t)||^ < WuoWn + + 71 r e-‘"1 

Jo 

< \\uo\\n + — + 7i [ e"^1l?^('S)||'Hds. 
Jo 


M(s)||^ds 


An application of the Gronwall’s inequality to v{t) := e ^*||u(t)||'^, gives then 

(4.73) ||^(t)||^< + 

preventing thus the blow up of a mild solution in finite time. 

Similarly, for mild solutions utv of (4.28), we have 


(4.74) 




(4.75) 


by noting that ||nAr|| < 1 for all > 1, \\TN{t)\\n < (see Lemma 4.3), and by using the sublinear 
growth assumption (4.69) on preventing also the blow up of any mild solution utv of (4.28), in 
finite time. 

Finally, (4.73) and (4.74) lead to 

II^^(L^^o)||'H < CiT, lli^olk), vt G [0,T], 

||uAr(t;nArno)||^ < C{T, ||uo||^), Vt G [0, T] and N G N*, 

where 

CiT, WuoWn) ■■= (||no|k + ^)e(‘"+^i)^. 

Now, we can follow the proof of Theorem 4.1 to obtain the desired convergence result (4.70), with 
the only difference consisting of the global Lipschitz estimates used therein, by the local Lipschitz 
condition (4.68) applied to T such that 

W^Wn<‘JC{T,WuoWn)- 

□ 


Corollary 4.3. Let A be defined in (4.24) with Ljj specified in (4.47) and Ls to be a bounded linear 
operator from to 


[CH98, Prop. 4.3.3] is derived for the case of contraction semigroups. However, the proof can be easily adapted to 
the case of more general Co-semigroups T{t) for which ||r(t)|| < Me“7 
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Assume that the nonlinearity T given by (4.66) is locally Lipschitz in the sense of (4.68). Assume 
also that the following energy inequality holds for T 

(4.76) (-A(^),4')h <7i||^llw + 72, 
where 71 G M and 72 > 0. 

Then, for each uq G D{A), the strong solution UAr(t; IIjvUo) of (4.28) emanating from IlArUO) and the 
strong solution^^ u{t;uo) of (4.23) emanating from uq, do not blow up in any hnite time. Moreover, 
U]sf{t;Il]sfUo) converges uniformly to u{t;uo) on each bounded interval [0,T], i.e.: 

(4.77) lim sup ||uAr(t;IlArUo) — u(t;uo)||'H = 0; VT > 0, uq G T>(A). 

Furthermore, any strong solutions v = u oi (4.23) or u = mat of (4.28), emanating respectively from 
u(0) = no G D{A) or n(0) = IlArno, have their 7^-norm controlled as follows: 

(4.78) ||t,(t)||?, < e"‘||t.(0)||?, + -!),«> 0. 

Kj 

where k = 2(a; + 71 ), with oj given in (4.49). 

Proof. Let uq G D{A), and let u be the mild solution of (4.23) emanating from no, such as ensured by 
the local Lipschitz condition on T. Then by adapting the proof of e.g. [CH98, Prop. 4.3.9],^^ we have 
that there exists a map T : D{A) —)• (0, 00 ], for which n G C([0, T{uo)), D{A)) H C^{[0,T{uo)),'H) and 
n solves the initial-value problem 

dw 

(4.79a) — = Au + P'{u), 

(4.79b) n(0) = no. 

By taking the ?7-inner product on both sides of (4.79a) with the solution n G V{A), and using the 
energy inequality (4.76) and the stability property (AT, T)-^ < a;||T|||^ from Lemma 4.2, we obtain 

(4.80) ^ {•^u,u)h + {J^{u),u)n < ^^\\u\\n + li\\u\\n + 12 , 

where the positive constant to is given by (4.49). 

It follows then from Gronwall’s inequality that 

(4.81) ll'^(L ^^o)lll^ ^ H-(c^* ~ 1)) ^ £ [0)7~'('^o))) '^0 £ 77(A), 

K 

where k = a; -|- 71 . 

Similarly, by noting that 

(n^^(T),T)^ = (^(T),T)^, VTg?7^, 

we have 

(4.82) \\uNit;IlNUo)\\‘^ < e''*||no|||^ + —(e'"* - 1), t G [0,r(no)), no G PL. 

Kj 

We have thus shown that for any initial data no G 77(A), the strong solutions n(t; no) and nAr(t; IlArno) 
do not blow up in any hnite time. The convergence result (4.77) can then be deduced as in the proof 
of Corollary 4.2. 

□ 


strong solutions of (4.23), we mean a solution in ClfO, T], D(A)) n of (4.23). 

^^The regularity result [CH98, Prop. 4.3.9] is stated for the case of contraction semigroups. However, the proof can 
be adapted to the case of Co-semigroups for which ||T(t)|| < (i.e. with M — 1) such as encountered here when Ld is 

as specihed in (4.47). 
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Remark 4.3. It is worth mentioning that the conclusions of Corollaries 4.1, 4.2 and 4.3 still hold 
when the underlying system of DDEs (4.65) is perturbed by a suitable time-dependent forcing, g(t). 
For instance, it suffices to assume that g{t) G oo); M'^) to still get the convergence results. □ 

4.3. Examples. In this section we provide some class of nonlinear scalar DDEs of the form (2.4) that 
fit with the assumptions of Corollary 4.3. In that respect we restrict our attention to the case of A 
such as defined in (2.8) for d = 1. We discuss below some classes of nonlinearities that verify the local 
Lipschitz condition (4.68) and the energy inequality (4.76). Extension to systems can be easily built 
out of these examples and are thus left to the reader. 


4.3.1. Delay equations with a global Lipschitz nonlinearity. 
which F is assumed to be of the form 

rO X / rO 


Let F be given such as in (2.10), and for 


(4.83) 


F 4' 




D 


(0)d0) =9{J + /i(4'‘ 


with g and h to be global Lipschitz maps from M to M, of constants Li and L 2 , respectively. Then, 
we have 

(/■(T),^)^ =9{j ^^(0)d0)T^ + /i(T^)T®, 

which gives 


(.^(4/), 4/)k < ^i| 'h^(0)d0||'L^| + (|<7(0)| + |h(0)|)|4/^| + 


— 7i 'I'i'i 


with 7 i > 0 and 72 > 0, and thus F satisfies the energy inequality (4.76). The local Lipschitz condition 
(4.68) for F is trivially satisfied under the assumptions on F. 

Note that such nonlinear equations arise in many applications where a delayed monotone feedback 
mechanism is naturally involved in the description of the system’s evolution; see [GZT08, Kri08, 
MPS96]. It is also interesting to mention that such seemingly simple scalar DDEs with global Lipschitz 
nonlinearity can also support chaotic dynamics as illustrated in Section 6.1 below. 


4.3.2. Delay equations with locally Lipschitz nonlinearity. We relax now the global Lipschitz require¬ 
ment. In that respect, we consider 

(4.84) 4/^(0)d0) = -(7i( T^(0)d0)52(d/^), 

and assume that 

(i) S'! : M —)> M"*" is locally Lipschitz; 

(ii) g 2 '■'S. is locally Lipschitz and verifies the condition 

(4.85) g2{x)x >0, X G M. 


These assumptions allow us to consider a broad class of nonlinear effects that are not necessarily 
bounded or polynomial. 

We check below that the abstract nonlinear map F defined in (2.10) with F given by (4.84) and 
that satisfy (i) and (ii), satisfies also the conditions of Corollary 4.3. We first check the local Lipschitz 
condition. 

Trivially, let us hrst remark that 


(4.86) 


||^(4/i)-.T(T2)||w = 


Fl 


1 ) 




F(4/f, 


4/f 
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Let US introduce the notations := 'hf and /3j := i = 1,2. Let 'Lj be chosen such 

that for i = 1,2, < -R for some R > 0. It follows that 

rO 


(4.87) 


\ai\ < R, lAI = 




< IIl 2 , 


and thus by definition of the 77-inner product ( 2 . 2 ) 

(4.88) \Pi\ <T\\'l>i\\n<TR, 
which leads to 

|F(ai,/3i)-F(a2,/32)| 

< \9i{Pi)92{ai) - 9i{l32)92{a2)\ 

(4.89) , , , 

< 5i(/?i)(52(01) - 52(02)) + (5i(/3i) - 5i(/32))52(o2) 

< L2(i?)|5i(^i)||oi - q; 2| + Li(ri?) 152 ( 02 )I|/3i - /52|, 

where Li(r) (resp. L 2 (r)) denotes the local Lipschitz constant associated with 51 (x) (resp. 52 (x)) for 

|x| < r. 

On the other hand, 

|5i(A)l < l5i(^i) - 51 (0)1 + |5i(0)| 

<Li(ri?)|/3i| + |5i(0)| 

< Til’Ll (ri?) + | 5 i( 0 )|, 

152(02)1 < iiL2(i?) + |52(0)|. 

|oi — 02 ! < llihi — 'I' 2 ||'h, 


and 

Note also that 
and that 


|/3i - ,021 < Vr\\^i - 4-2 IIl 2 < rll^-i - ^2 ||h- 
We obtain then from (4.89) that 

(4.90) \F{ai,/3i)-F{a2,l32)\<L{R)\\d>i-^2\\n, 
where 

L{R) :=L 2 (i^)(^/^i^Ll(rii) + |5l(0)|) + rLi(Tii)(iiL 2 (ii) + |52(0)|), 

which gives the local Lipschitz property of as a map from % to %. 

The energy inequality (4.76) is here readily satisfied since 

/ „ /"O 

(4.91) 


(.T(T),T)h = t('I/^, 




D 


< 0 , 


because of (4.85). 


Remark 4.4. 

(i) Note that famous delayed models from population dynamics are covered by Corollary 4.3, 
although not satisfying (4.84). For instance, delayed logistic equations of the form 

(\x / \ 

(4.92) — = rx{t)(^l - K~^ J a;(s)/(x(s))dsj, r, iL, r > 0 , 

with (jj G L°°(M, M"'') and / G iy^(M,M+) satisfying the inequality 

\f{x)-f{y)\ <7^-51, 
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for some 7 > 0 and for almost every x,y are still covered by Corollary 4.3. 

(ii) Note also that many other nonlinear effects could have been considered in (2.4) for which the 
convergence result of Corollary 4.3 would hold. For instance we could have considered 


(4.93) 



P > 2, 


where each bj is a local Lipschitz function in L°°(M) and 62^-1 (•) < /3 < 0 for some constant 

13 . 

Under these assumptions, the nonlinearity (4.93) satisfies the energy inequality (4.76) with 
7 i = 0 and with 72 sufficiently large, depending on the L°° norm of the functions 6 j’s. This is 
because the term with the largest power (T'^)^^”^ is strictly negative by assumption on b 2 p-i, 
and the other terms with a lower degree can be controlled by using Young’s inequality. □ 


5. Galerkin approximation: Analytic formulas for scalar DDEs 


This section is devoted to the derivation of explicit expressions of the Galerkin approximation (4.28) 
associated with nonlinear DDEs. For simplicity, we focus on the case of a scalar DDE taking the form 
given by (2.4). The more general case of nonlinear systems of DDEs is dealt with in Appendix C; see 
also Appendix C.2 for the case where the linear part of (2.4) involves a distributed-delay term as in 
(4.65). 

As a preparation for the forthcoming analytic derivations, we need to express the derivative of the 
Koornwinder polynomials in terms of the polynomials themselves. This is the content of the following 
proposition. 

Proposition 5.1. The Koornwinder polynomial Kn of degree n G N defined in (3.3) satisfies the 
differential relation 

n—1 


(5.1) 


ds 


(s) — ^ ^ ®n,fcArfc(s), s G ( 1,1), 


k=0 


where the coefficients an := {anfl, • • • , an^n-iY'^, satisfy the upper triangular system of linear equations 
(5.2) To„ = bn, 

with T := {Tij)nxn and bn := {bn,o, ■ , &n,n-i)*’' given by 

0 , if j < i, 

+ 1 , if j = i, where 

_-( 2 f-|-l), ifj>f, 

\{2i + l){n + i + l)(n - i), 




(5.3) 




= < 


0 < f, j < n — 1, 

if n -|- i is even. 


if n -|- z is odd. 


[rr + n){2i + 1) — ^{n + i){n — i + 1 ) 

-\{i + l)[n - i - l){n + i + 2), 

For the rescaled version defined by (3.18), it holds that 

d K’’ 2 

(5.4) ^(0) = _Va„,fcK,"(0), nGN, 0G(-r,O). 

k=0 


de 


Proof. See Appendix B. 


□ 
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Let US now rewrite the unknown ujsf in the Galerkin system (4.28) in terms of the first N rescaled 
Koornwinder polynomials, i.e.: 


N-l 


(5.5) 

where 

(5.6) 


rt=0 


UN{t) = ^ Vn{t)K7^, t > 0, 


yn{t) = 


||/C, 


nWU 


We then replace ttw in Eq. (4.28) by the expansion given in (5.5), and take the L^-inner product on 
both sides with /CJ for each j G {0, • • • , W — 1} to obtain: 


(5.7) 


= E y„(t)/c); ] ,/c] 


N-l 


' N-l 


dt 


n=0 


n=0 


n 


Recall that the linear operator A here is defined by (2.8). Then, for each n G {0, ■ 
holds that 


,N-1}, it 


AT-l 


(5.8) 


Afq^n = TijqAKd^ = 


1=0 




L 2 


+ + bK^{—T) + c 


K’’ 


JCJ 




We obtain then that 


(5.9) 


+ (n-^n(O) + + C 


k: 




It follows from the expression of in (5.4) that 


1 

T 


d+ K'^ 9 ^ ) 

^-{9)KJ{e)d9 = -J2an,k 

k=0 
„ n—1 


d9 


KU9)KU9)d9 


(5.10) 


Y,an,k{{}Cl,}C])n-KU0)KJ{0)) 


k=0 

n-l 


Y.an,k fel|/CJ|||,-l) 


/c=0 


where 5j^k denotes the Kronecker delta, and the last equality above follows from the orthogonal prop¬ 
erty of the Koornwinder polynomials as well as the normalization property K^{0) = 1; cf. (3.20). 

Note that Kq = 1, which follows from the definition of the Koornwinder polynomials Kn given by 
(3.3) and the fact that the first Legendre polynomial Lq is identically 1. We get then ||/C5||f^ = 2. 
Note also that 


fO 


(5.11) 
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leading thus to 
(5.12) 


K^{e)de = Ti26n,o-l), neN. 


By using (5.12), the normalization property KJ(0) = 1 and the identity KJ{—t) = Kj{—1) (valid for 
any j > 0), we obtain 

(5.13) (^aK;,{0) + bKl{-T) + c j Kl{9)de'^KJ{0) = a + bKn{-l) + CT{25n,o - 1). 

Now, by using (5.10) and (5.13) in (5.9), we obtain 

Af-l Af-1 

^ yn{t) {AnJCI,]C^)^ = ^ (a + bKn{-l) +CT{2Sn,0 - 1) 

(5.14) 


n=0 


n=0 


n—1 


+ ^n,k ^ 


k=0 


For the nonlinear part, since (ITtv^*, for all G and all n G {0, 
together with the definition of J- given in (2.10), we obtain 




N-l 


^N-1 


(5.15) 


n=0 


,0 N-l 


2/n(t)/C;),/Cj)^ = ^ ^ ^ ynmnmo 


. n=0 


From (5.12), it also follows that 

ro N-i 

(5.16) 


n=0 


Af-1 


[ '^yn{t)Kl{e)dB = Tyo{t) 

n=0 n=l 


By using (5.16) in (5.15), we get 

N-l 


(5.17) 


niv-^( J] ?/„(t)/c) 


/N-l 


N-l 


n=0 


n 


ICl 


n 


F X] 'ryo{t) - T X] 


^n =0 


n=l 


Now, by using (5.14) and (5.17) and recalling that ||/C)(||'^ = ||/C„||£:, we obtain from Eq. (5.7) the 
following explicit form of the A^-dimensional Galerkin system (4.28): 


dy 


1 


Y-l 


= PTJI E (“++‘="(2'5».o - 1 ) 

" -J ''o n=0 

„ n—1 


(5.18) 


d~ 'y ^ 0‘n,k II Ilf 1 


k=0 

^ /N-l N-l \ 

+ Iir 112 ^ ( ^ yn{t),Tyo{t) Vnit) ] , 0 < j < IV - 1. 

Vn=0 n=l / 

For later usage, we rewrite the above Galerkin system into the following compact form: 
(5.19) ^ = Ay + G{y), 
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where Ay denotes the linear part of Eq. (5.18), and G{y) the nonlinear part. Namely, A is the N x N 
matrix whose elements are given by 


(5.20) 


{A)j^n = nj no + bKni-l) + CT{26n,0 “ 1) 


n—1 


+ - ^ an,k “ ^) ) ■ 


A:=0 


where j,n = 0, ■ ■ ■ ,N — 1, and the nonlinear vector field G: 


is given component-wisely by 


(5.21) 


^ /N-l N-l \ 

Gj{y) = ]|;p -||2 ^ ynit),'ryo{t) -tJ 2 Vnit) J , 0 < j < iV - 1. 
Vn=0 n=l / 


Remark 5.1. When a time-dependent forcing g{t) is added to the RHS of the DDE (2.4), the only 
change in the corresponding Galerkin system is to add a term \\}Cj\\g‘^g{t) to each Gj in (5.21). 
Recall also from Remark 4.3 that it is sufficient to require that g G L^q^(M;M) in order to ensure the 
convergence result of the Galerkin system over any finite interval. □ 

6. Approximation of chaotic dynamics: Numerical results 

In this section, we report on the performance of our Galerkin schemein approximating quasi-periodic 
and chaotic dynamics. In the case of the latter, it is well known that any finite-time uniform conver¬ 
gence result — such as the one given by (4.77) and obtained in Gorollary 4.3 — becomes less useful, 
due to sensitivity to initial data. 

In this case, when individual solutions diverge exponentially, it is natural to consider instead the 
approximation of the strange attractor or of the statistics of the dynamics. More generally, the 
approximation of meaningful invariant probability measures supported by the strange attractor is 
of primary interest in chaotic dynamics. Nonlinear DDEs, like those considered here, are known to 
support such probability measures once a global attractor is known to exist [GGH12]. 

If, in addition to the finite-time uniform convergence (4.77), a uniform dissipativity assumption 
is satisfied, then any sequence of invariant measures associated with the Galerkin approximation 
converges weakly to an invariant measure of the full system; see [Wan09, Thm. 2.2]. The uniform 
dissipativity assumption referred to in [Wan09] is satisfied if one can establish, uniformly in N, the 
existence of an absorbing ball for the Galerkin reduced systems in another separable Hilbert space V, 
which is compactly imbedded in 77, in the case of strongly dissipative systems. 

We show in Sections 6.1 and 6.2 below that, for two simple nonlinear scalar DDEs that — even in 
instances in which the uniform dissipativity assumption of [Wan09, Thm. 2.2] is not guaranteed — our 
Galerkin scheme is still able to approximate significant statistical properties of the chaotic dynamics, 
or the strange attractor itself. Einally, we illustrate in Section 6.3, for a highly idealized ENSO model 
from climate dynamics that our approach also works in the case of periodically forced DDEs with 
multiple delays. 

6.1. “Nearly-Brownian” chaotic dynamics. We consider here a modified version of the DDE 
analyzed in [Spr07] with a sinusoidal nonlinearity. The modification consists of replacing the discrete 
delay by distributed delays. As we will see, this modification does not affect the main dynamical 
properties identified in [Spr07] in the case of a discrete delay, once the proper parameter values are 
chosen. 
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More precisely, we consider the following DDE 

(6.1) x = asm(^J^ x(s)ds^, 

with a = 0.5 and r = 5.5. This example fits within the general class discussed in Section 4.3.1, to 
which the rigorous convergence results described in Sections 4.2 in an abstract setting, and in Section 
5 more concretely, do apply. 

As pointed out in the introduction of this section, such finite-time uniform convergence results 
are essential in general, but they are not the ones we are necessarily looking for in approximating 
chaotic dynamics. We rely, therefore, on careful numerical simulations to explore the performance 
of our Koornwinder-polynomiaDbased Galerkin systems to approximate the statistical features of the 
chaotic dynamics in these examples. 

A sample trajectory of Eq. (6.1) is shown in black in Fig. 2. While the governing DDE is perfectly 
deterministic, the visual resemblance of this trajectory to a sample path of Brownian motion is obvious. 
A trajectory with the same constant initial history over the interval [—r, 0), but obtained by solving 
a lOD-approximation by our Galerkin scheme of the DDE, is shown as the red curve in the figure. It 
is clear that individual trajectories do have the same overall behavior, which is nearly Brownian, but 
the pointwise approximation of the exact trajectory by the approximate one is not good. 

To study instead the statistics of the solutions, we have estimated — for a collection of n = 10^ initial 
histories of constant value drawn uniformly in [—1,1] — the empirical probability density function 
(PDF) of the corresponding x(t)-values at a given time t. Figure 3 reports on the numerical results 
at t = 2680 when x{t) is simulated from Eq. (6.1) by forward Euler integration (black curve) with a 
time step of At = r/2^^, and when x{t) is approximated by a lOD-Galerkin approximation (red curve) 
obtained from the analytic formulas (5.19)-(5.21) applied to Eq. (6.1). 

The Galerkin system of ODEs is integrated using a semi-implicit Euler method that still uses 
At = t/2^^, but in which the linear part Ay is treated implicitly, while the nonlinear term G{y) is 
treated explicitly. The approximate solution xisf{t), provided by an A-dimensional Galerkin system 
of the form (5.19), is obtained by using the expansion (5.5) into Koornwinder polynomials. More 
precisely, XAr(t) is obtained as the state part of un given by (5.5) which, thanks to the normalization 
property K^{0) = 1 given in (3.20), reduces to 

N 

(6.2) XAr(t) = ^yj(t), 

i=i 

where y := (yo, • • • tUn-i) is the vector solution of (5.19). 

Also shown in blue in panels (a, c) of Fig. 3, is a Gaussian distribution with the same mean and 
standard deviation, both of which are estimated from the x(t)-values at t = 2680 of the simulated DDE 
solutions. In both cases, the empirical distributions, as obtained from the simulated DDE solution or 
as obtained by using a Galerkin approximation with N = 10, closely follow a Gaussian law. 

For both x(t), as simulated by numerically solving Eq. (6.1), and X]\f{t), as obtained by using 
a Galerkin approximation with N = 10, the standard deviations of the corresponding collection of 
trajectories are shown versus time in panels (b) and (d) of Fig. 3. The best linear regression fit of 
log((T) versus log(t) gives a = 0.195t‘^''^^®, in the case of Eq. (6.1), and a = O.IOOt’^'^®*’, in the case of 
the lOD-Galerkin approximation. 

In both cases, the slopes of the fitted lines indicate that the deterministic dynamics of Eq. (6.1) 
mimics that of Brownian motion, for which the slope would be 0.5, with a diffusion coefficient D = /t. 

In particular, the solutions do not stay within any bounded subset; the dynamics thus violates any 
dissipation criterion, while still possessing an attractor with strange behavior (not shown). 
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Trajectories 



Figure 2. Trajectory x{t) simulated by the DDE (6.1) (black curve), and its lOD-Galerkin approx¬ 
imation XN{t), with = 10 (red curve), obtained by the method described in Section 5. 


To the best of our knowledge, the lOD-Galerkin approximation computed here thus provides the 
first example of a chaotic system of ODEs whose solutions exhibit a statistical behavior close to that 
of Brownian motion. 

6.2. Bimodal chaotic dynamics with low-frequency variability. The model studied in this 
subsection, 

(6.3) X = ax{t — t) — bx{t — r)^, 

is also based on [Spr07]; the parameter values used here are a = 0.5, 6 = 20 and r = 3.35. Remark 6.1 
at the end of this subsection discusses similarities between the dynamics of the model above and 
important aspects of ENSO dynamics. 

In contrast to the DDE considered in the previous subsection, Eq. (6.3) does not fit directly within 
the general framework of Section 4.2, for which rigorous convergence results are available. The discrete 
lag present in the cubic term leads to complications for a rigorous analysis. Replacing this lag effect 
by a distributed one, as in Eq. (6.1), would place the DDE of Eq. (6.3) into the class considered in 
Section 4.3.2, for which finite-time uniform convergence results are guaranteed. But even then, we 
cannot be assured a priori of an effective approximation of statistical features of the dynamics, as 
discussed above. 

The purpose of this subsection is to show that, even in such a borderline case with respect to the 
theory presented in this article, statistical and even topological features can still be remarkably well 
approximated by the Galerkin systems of Section 5, when appropriately modified to handle the case 
of discrete delay in the nonlinear terms. 

^®This modification consists just of noting that, by replacing the nonlinear term with distributed delays in (2.4) by 
F{x{t),x{t — t)), the identity (5.15) becomes 

N-l /N-1 N-1 

(6.4) (nvT(^ t/„(t)/c;),A:})^ = ^ j/4B-f„(-i) 

n=0 \n=Q n=0 

the latter, in turn, leads to the corresponding change in the formula (5.21) for the nonlinear vector field in Eq. (5.19). 
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Standard deviation from DDE data 



Standard deviation from Galerkin data 



Figure 3. (a, c): Probability density functions (PDFs); and (b, d): standard deviations ct, as 
estimated from the simulations of the DDE (6.1) (black curve and black circles, in the left panels and 
the right panels, respectively), and its lOD-Galerkin approximation (red curve and red circles) by the 
method described in Section 5, respectively. In each of the panels (a) and (b), the results are compared 
with a Gaussian distribution estimated by standard analytic formulas (blue curves), and in each of the 
panels (c) and (d), the results are compared with the best linear regression fit (blue curve) of log((T) 
versus log(t), providing the corresponding slope and the exponent reported therein. 


As shown in the left panel of Figure 4 in natural delayed coordinates, the strange attractor associated 
with Eq. (6.3) (black) has a nearly symmetric topological shape and is constituted by two fairly high- 
density “islands” connected by a foliation of heteroclinic-like orbits. These properties of the attractor 
are very well captured by a 6D-Galerkin approximation (right panel, red). 

These two high-density islands, along with the lower-density areas of heteroclinic-like connections 
between the two, give rise to a bimodal chaotic behavior, which gives rise, in turn, to an interesting time 
variability. Figure 5 plots the results of a standard numerical estimation of the spectral density — also 
known in the engineering literature as the power spectrum — associated with x{t), as directly simulated 
using Eq. (6.3) (black curve) and as approximated by a 6D-Galerkin approximation (red curve). 
In both cases, the power spectra are estimated from the corresponding autocorrelation functions 
[ER85,GAD+02]. 

The numerical results show that the spectrum of x{t) contains two broadband peaks at low fre¬ 
quencies that stand out above an exponentially decaying background. As shown in Eig. 5, these 
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Attractor from DDE 



Attractor from Galerkin approximation 


Figure 4. The attractor associated with Eq. (6.3) (left panel) and its approximation obtained from 
a 6D-Galerkin approximation (right panel). 



Figure 5. Power spectral density of x{t) as simulated from Eq. (6.3), and from a 6D-Galerkin 
approximation derived from the analytic formulas described in Section 5 and applied to Eq. (6.3). 


two peaks, as well as the exponential background, are strikingly well approximated by a 6D-Galerkin 
approximation, in both amplitude and frequency, as well as in the rate of decay for high frequencies. 

The approximation by a truly low-dimensional, 6D-Galerkin model of these key features of the 
power spectrum of the solutions to the DDE (6.3) has deep dynamical implications in terms of the 
Ruelle-Pollicott resonances and mixing properties of the dynamics on the attractor [CNK'*'14]. These 
implications are beyond the scope of this article but we intend to discuss them elsewhere. 
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Remark 6.1. Equation. (6.3) can actually be seen as a highly idealized ENSO model with mem¬ 
ory effects; see [BH89, CMZ90, Dij05, GCS15, GTOO, GZT08, KS14, MCZ91, TSCJ94, ZGIO, vR13] and 
references therein. Indeed, for the given parameter values, the solution of Eq. (6.3) admits two 
metastable states, as can be seen from the two islands in the attractor given in Figure 4. These 
two metastable states are analogous to the warm, El Nino and the cold. La Nina states in ENSO 
dynamics. Moreover, the two broadband peaks at low frequencies in the spectral density of the so¬ 
lution, as shown in Figure 5, are also reminiscent of the quasi-quadrennial and the quasi-biennial 
mode in ENSO [GROO, GAD’^02, JNG95] dynamics. The important role of such low-frequency vari¬ 
ability in the understanding and prediction of climate dynamics on various time scales was emphasized 
in [GKGll,DG05, GhiOl,GROO, GR02] and references therein. □ 


6.3. A highly idealized ENSO model with memory effects. In this section, we consider the 
following periodically forced DDE with two discrete delays [GZT08]: 

(6.5) X = —atanh(Kx(t — ti)) -|- /3tanh(«;x(t — T 2 )) + 7cos(27rt). 

This equation is a slightly modified version of the model used in [TSGJ94] for the study of the 
interaction between the seasonal forcing and the intrinsic ENSO variability.^^ We also refer to [BH89, 
CMZ90, Dij05, GGS15, GTOO, GZT08, MCZ91, TSCJ94, ZGIO, vR13, GZ15] and references therein for 
other models with retarded arguments used in this context. 

The purpose of this subsection is to show that the Galerkin scheme developed in this article can also 
be easily adapted to deal with DDEs with multiple delays, as well as with non-autonomous, forced 
DDEs. For this purpose, Eq. (6.5) is placed in a quasi-periodic regime by choosing the parameter 
values a = 2.1, f3 = 1.05 ,7 = 3, k = 10, ti = 0.95, and T 2 = 5.13. 

We outline now the necessary modifications to the nonlinear term G{y) in the Galerkin system (5.19) 
for the case of multiple discrete delays. As a direct generalization of the case with a single discrete 
delay, given in footnote 13, the nonlinearity F in (2.4) takes the form F{x(t),x{t — ri), • • • , x{t — Tp)), 
where 0 < ri < • • • < Tp =: r. In this more general situation, the identity (5.15) becomes 


N-l 


UNF(J2ynit)Jci 


/N-l 


N-l 


( 6 . 6 ) 


n=0 


n I 1 


n 


X] X] yn{t)Kn{- 


\n=0 

N-l 


n=0 


n. 
r ' 


^ yn{t)Kn{-'^^), ^ yn{t)Kn{-l) 


N-l 


n=0 


n=0 


which leads to the corresponding change in the formula (5.21) for the nonlinear vector field in 
Eq. (5.19). Note also that the forcing term is dealt with in Remark 5.1. 

Again, we compare the DDE’s attractor in the left panel of Fig. 6 with the attractor obtained from 
an associated Galerkin system, in the right panel. Despite the complexity of the DDE’s attractor, a 40- 
dimensional Galerkin system can already provide a very accurate reconstruction of this attractor. The 
need for a higher dimensionality of the Galerkin approximation in this case arises from the presence 
of incommensurable frequencies in the periodically forced model, namely the seasonal cycle and the 
internal frequencies [Dij05, JNG94, GR00,GR02,TSCJ94]. 


Acknowledgments 

This work has been partially supported by the Office of Naval Research (ONR) Multidisciplinary 
University Research Initiative (MURI) grant N00014-12-1-0911 (MDG, HL and MG) and by National 
Science Foundation (NSF) grant DMS-1049253 (SW). 

^^The nonlinearity used in [TSCJ94] consists of a sigmoid made of two tanh segments joined continuously by a line 
segment, cf. [MCZ91, Eq. (9)]; this sigmoid is simplified here to be just a hyperbolic tangent function. 
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Attractor from DDE Attractor from Galerkin approximation 



— 7 - 2 ) x{t — T 2 ) 


Figure 6. The attractor associated with Eq. (6.5) (left panel) and its approximation obtained from 
a 40D-Galerkin approximation (right panel). 


Appendix A. Proof of Theorem 3.1 

The identity (3.5) follows from the definition of given in (3.3) and the properties of the Legendre 
polynomials Ln given by (3.13) and (3.15). The normalization iL„(l) = 1 results directly from the 
identity (3.5) and the normalization Lri(l) = 1 as recalled in (3.12). 

The orthogonality property of (iL„, A„(l)) is proved in [Koo84, Theorem 3.1]. The formula (3.10) 
about the norm can be checked directly by using (3.5) and the orthogonality property of the Legendre 
polynomials recalled in (3.11). 

Finally, it remains to show that | \\K"\\e } ^ Hilbert basis of £ which due to the orthonormality 

property boils down to show that the linear space spanned by the /C^’s is dense in . In that respect, 
by recalling that K,n = {Kn-,Kn{^)) and that are polynomials of degree n orthogonal under the 
inner product h follows that any function in the subspace 

<Sn ■= {(/)/(!)) : / is a polynomial of degree n} 

admits a unique expansion in terms of {{Kq, Kq{1)), ■ ■ ■ , (iL„, A'„(l))}. Note also that i® 

dense in the subspace 

C := {(/, /(I)) : / is a continuous function on [—1,1]}, 

which is itself dense in 

C := {(/, o) : / is a continuous function on [—1,1], and a G M}. 

Since the last subspace C is dense in £, the desired result follows. □ 

Appendix B. Proof of Proposition 5.1 

Note that an '■= {an,o, • • • ,an,n-i)*'^ given in (5.1) can be obtained by rewriting both sides in terms 
of the Legendre polynomials and comparing the coefficients, which leads to the algebraic equation 
Tan = bn to be satished by a^. We provide below some details about the derivation of the matrix T 
and the vector b given in (5.3). 
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First note that by the definition of given in (3.3), we get 


(B.l) 


. d 


-(1 + s)—Ln{s) 

as 


+ (n^ + n + 1) 


di^n(s) 

ds 


By using then the recurrence formula for the derivative of given in (3.15), we obtain 


(B.2) 


— (1 + s) {2k + l)Lfc(s) 

k&In 

+ (n^ + 7T. + 1) ^ ^ {2k + l)Lfc(s) 

k^In 

= — {2k + l)Lfc(s) — (1 + s) {2k + 1)—^ 

k^In k^In 

+ (n^ + 7T. + 1) ^ ^ {2k + l)Lfc(s) 

kSln 

= {v? + R-) ^ (2A: + l)Lfc(s) 

kGl-n 

“ (1 + ■s) ^ ^(2^ + l)(2j + l)I/j(s), 

k^In j^Ik 


<iK„ d 

= S 


where we recall from (3.16) that /„ = {A:GN:0<A:<n — l,A: + nis odd}. 

By using again the definition of Kn given in (3.3), the RHS of (5.1) can be rewritten in terms of 
the Legendre polynomials as follows: 


(B.3) 


n—1 

k=0 


n—1 


^ ^ ^n,k 


k=0 


— (1 + s) — L}.{s) + {k^ + k l)L^(s) 
ds 


n—1 n—1 

k{2j + l)Lj{s) + CLn,k{k'^ + k + l)Lfc(s). 
k=0 jGik k=0 


Now, by using (B.2) and (B.3) in the expansion ^^(s) = Ylk=o ^n,kKk{s), we obtain 


(B.4) 


n—1 n—1 

k{2j + l)Lj{s) + a,n,k{k‘^ + k + l)Lk{s) 

k=0j£lk k=0 

= (n^ + n) {2k + l)Lfc(s) — (1 + s) {2k + l){2j + l)Lj(s). 

kGin k^In 
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Finally, by using the three-term recurrence formula (j -|-l)Lj_|_i(s) = (2j-|- l)sLj{s) — jLj_i(s) recalled 
in (3.13), we obtain from Eq. (B.4) that 


n—1 

[(j + l)-^i+i('S) + (2j + l)Lj{s) + jLj-i{s)] 

k=ojeh 

n—1 

^ (in,k{k‘^ + k + l)Lfc(s) = (n^ -|- n) ^ ^ {2k + l)Lfc(s) 

k=0 kdin 

-EE {2k + 1) [{j + l)Lj+i(s) -|- {2j + l)Lj{s) + jLj-i{s)] . 

k^In j^Ih 


The system of algebraic equations given in (5.2)-(5.3) can then be obtained by equating the coefficients 
for Ln-i, ■ ■ ■ , To on both sides of the last equation above. The proof is now complete. □ 


Appendix C. Analytic formulas for nonlinear systems of DDEs 

In this section, we extend the analytic formulas of Section 5 to nonlinear systems of delay equations 
of the form (4.65) based on the vectorized Koornwinder polynomials introduced in subsection 3.3. 
Recall that (4.65) is given by 

(C.l) ^ = Ls:x.{t) + B:K{t - t) + C{s - t):x.{s)ds+ F(^^{t), x(s)ds^, 

where F : x M'^, and Ls, B, and C are as given in (4.47). 

Recall also that the unknown function mtv in the corresponding Galerkin system (4.28) takes values 
in the A^d-dimensional subspace Bn defined in (4.26). We can thus rewrite uw in terms of the first 
Nd vectorized Koornwinder polynomials (see (3.32)) as follows: 


(C.2) 


Nd 

UN{t) = '^yj{t)K'j, t>0, 


where 

(C.3) 


yj{t) 


{uN{t),Wj)n 


j = !,■■■ ,Nd, 


with jg determined by (3.29) and Bi being the product space T^([—r,0);M) x M equipped with the 
inner product given by (2.2). 

In the following, we first deal with a special case in subsection C.l by assuming that the linear 
operator C in the system (C.l) is time-independent. Necessary changes for the time-dependent case 
is then outlined in subsection C.2. 


C.l. The case when C in (C.l) is time-independent. In this case, all of the three linear operators 
Ls, B and C are dx d matrices. By the same type of computation as given in Section 5 for the scalar 
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case, we obtain the following A^d-dimensional ODE system for (yi, • • • ,yNd)- 




W^jqWs 


Nd nq-1 


E 


^nq,k i^jqMl^jqWs 




/c=0 


(C.4) 


{Ls)jr,nr Knq{ 1) B{‘^^Tlq ,0 ^)C'jr,' 


Vnit) 


^ / Nd Nd \ 

+ 11^ ||2 ^jr ( y^(2^n5,0 ~ l)K,i(l)y„(t) j , 


n=l 


where j = I,-- - ,Nd, and where given an integer I G {I,-- - ,Nd}, the associated integers Ig G 
{0, • • • , A^ —1} and G {1, • • • ,d} are determined by (3.29)-(3.30). The coefficients Uij are determined 
by (5.1), and S denotes the product space L^([—1,1);M) x M equipped with the inner product given 
by (3.9). 

The above Galerkin system can be put into the following compact form: 


(C.5) 


'^=Ay + a(y). 


where Ay denotes the linear part of Eq. (C.4), and G{y) the nonlinear part. Namely, A is the Nd x Nd 
matrix whose elements are given by 


(C.6) 


lie'. Ill 


r „ nq-l 


yy ^nq,k {_^jq,k\\^jq\\s l) ^rirjr 


k=0 


+ {Ls)jr,nr + ^Uqi l)-Sjr,nr. + 7{25nqfl ^)C^jr,r, 


where j, n = 1, • • • , Nd, and the nonlinear vector field G: —>■ is given component-wisely by 

/ Nd Nd \ 

(C.7) Gg{y) = {Y,yn{t)Kn{l), r - l)Kn{l)yn{t) • 

Vn=l n=l J 


C.2. The case when G in (C.l) is time-dependent. We outline below necessary modifications to 
(C.6) when G G ^^([-r, 0); 


Note that the contribution from the term G{s — t)x(s)ds to the component Aj^n given in (C.6) 


is: 


(C.8) 


«.-,n = ( r C(0)K;(0)d0,KJ(O)). 


Note also that C'(0)K))(0)d0 is a d-dimensional column vector, whose component is given by 

f_,Ck,nA0)Kl^{0)<^e where 1 < k < d. 

It follows then 


(C.9) 
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Since each component of C belongs to L^([—r, 0);M), by the identity (3.24) given in Lemma 3.1, we 
have 


(C.IO) 

It follows then 


G.J = E 


(Cj KT) [2 

rj K[, l<i,j<d. 


E 


r||/C 

r||/C :"2 / 


Ki{e)Kue)de. 


Since = Sij, we get 


Ki{e)Kj{e)de = -1 ), ij g n, 


leading thus to 


(C.ll) 


E 

1=0 


{Cjr,nr, ^ ||j-T||2 








jr,rt.r 1 L'^ ^ ^ II 


1=0 


Hi 


— { ^jr,nr: d^riq ) ! 

where we have used which follows from the identity (3.22) in Lemma 3.1. 

I|A, 

So the only modification to (C.6) is to replace the term r(2(5n,,o — l)Cir,nr by {Cj^^nr-,Knq)L"^- Note 
that when Cj^^rir ^ -b^([—r, 0); M) is a constant function, the latter is reduced into the former since 

j\uO)d9 = Ti26n,o-l), neN. 

To summarize, when C is time-dependent, the A^d-dimensional Galerkin approximation associated 
with (C.l) still takes the form (C.5) with the nonlinear part G{y) given by (C.7), and the elements of 
the Nd X Nd matrix A, given by 


(C.12) 
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